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Active avoidance (AA] is an important paradigm for studying meclianisms of aversive instrumental learning, patliological 
anxiety, and active coping. Unfortunately, AA neurocircuits are poorly understood, partly because behavior is highly var- 
iable and reflects a competition between Pavlovian reactions and instrumental actions. Here we exploited the behavioral 
differences between good and poor avoiders to elucidate the AA neurocircuit. Rats received Sidman AA training and ex- 
pression of the activity-dependent immediate-early gene c-fos was measured after a shock-free AA test. Six brain regions 
with known or putative roles in AA were evaluated: amygdala, periaqueductal gray, nucleus accumbens, dorsal striatum, 
prefrontal cortex (PFC], and hippocampus. Good avoiders showed little Pavlovian freezing and high AA rates at test, the 
opposite of poor avoiders. Although c-Fos activation was observed throughout the brain, differential activation was found 
only in subregions of amygdala and PFC. Interestingly, c-Fos correlated with avoidance and freezing in only five of 20 dis- 
tinct areas evaluated: lateral amygdala, central amygdala, medial amygdala, basal amygdala, and infralimbic PFC. Thus, ac- 
tivity in specific amygdala -PFC circuits likely mediates the competition between instrumental actions and Pavlovian 
reactions after AA training. Individual differences in AA behavior, long considered a nuisance by researchers, may be 
the key to elucidating the AA neurocircuit and understanding pathological response profiles. 



Many anxiety disorders are characterized by abnormal fear and 
avoidance following aversive experience. This usually means ex- 
cessive fear, failure to suppress fear, or adoption of avoidance pat- 
terns that interfere with normal activities. These symptoms are 
thought to arise from maladaptive threat processing in brain cir- 
cuits tasked with defense and coping (LeDoux 2012). 

Threat processing has been intensely studied with animal 
models of Pavlovian learning, like fear (threat) conditioning and 
extinction. However, much less is known about the neural circuits 
mediating active avoidance (AA), a form of instrumental condi- 
tioning that depends on Pavlovian conditioning (Mowrer and 
Lamoreaux 1946; Rescorla and Solomon 1967; Levis 1989; 
McAllister and McAllister 1991). In AA, subjects learn that specific 
actions will escape threats (conditioned stimuli [CSs]) and prevent 
harm (unconditioned stimuli [USs]). AA mechanisms evolved 
because they are, on balance, adaptive. Unlike Pavlovian reac- 
tions, which prepare animals for impending harm, proactive AA 
responses allow subjects to control exposure to threats and avert 
pain or injury altogether. AA responding also blocks the expres- 
sion of Pavlovian reactions (Solomon and Wynne 1954; Baum 
and Poser 1971; Choi et al. 2010; Lazaro-Munoz et al. 2010), 
which, in humans, are associated with unpleasant feelings like 
fear (Delgado et al. 2006). And unlike passive avoidance, AA can 
be an effective way to remain safe without disengaging from envi- 
ronments that include danger (Cain and LeDoux 2008). Though 
avoidance can become pathological when it interferes with 
healthy activity, a different and profound form of pathology can 
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result when threat reactions, like freezing, prevent the expression 
of adaptive avoidance responses. 

Most animals successfully acquire AA; however, some fail to 
show AA responses even after extensive training. Although "poor 
avoiders" are usually excluded from analyses of AA under the 
assumption that they fail to learn (e.g., Bolles and Popp 1964), 
we recently demonstrated that poor avoidance reflects a perfor- 
mance deficit, not a learning deficit. Indeed, poor avoiders freeze 
excessively, and lesions of the central amygdala that eliminate 
Pavlovian freezing rescue AA responding without further training 
(Choi et al. 2010; Lazaro-Munoz et al. 2010). In the present study, 
rather than excluding poor avoiders, we exploited these stark 
behavioral differences to help elucidate the AA neurocircuit. We 
reasoned that good and poor avoidance result from differential re- 
cruitment of brain circuits associated with instrumental actions 
and Pavlovian reactions. By contrasting the neural activity ob- 
served in these groups we were able to examine neurocircuits 
associated with AA expression while circumventing tricky instru- 
mental control issues that have hampered previous research 
(Church 1989; Nikolaev et al. 1992). Critically, this approach 
aligns with recent efforts to focus animal models of anxiety on 
atypical, rather than typical, responding (Yehuda et al. 2006; 
Yehuda and LeDoux 2007; Sotres-Bayon et al. 2008). Since only 
some individuals develop pathological anxiety, approaches that 
focus on individual differences are more likely to provide key in- 
sights into neural processes awry in human disorders. 

Forty-two rats received seven Sidman AA training sessions 
and good (n = 5) and poor (n = 6) avoiders were selected for com- 
parison to each other and to nontrained box controls (« = 5). Rats 
were sacrificed 90 min after a shock-free AA test. c-Fos was mea- 
sured as an index of neuronal activity, because expression of 
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this immediate-early gene (lEG) product has proven useful in past 
studies of behavioral neurocircuits (e.g., Knapska et al. 2007). 
c-Fos was quantified in six brain regions with known or putative 
roles in AA: amygdala, medial prefrontal cortex (mPFC), periac- 
queductal gray (PAG), dorsal striatum, nucleus accumbens 
(NAC), and hippocampus. This approach identified only five dis- 
crete subregions of amygdala and mPFC that were associated with 
good vs. poor avoidance, suggesting that these regions represent 
critical components of the AA neurocircuit that contribute to re- 
sponse variability. 

Results 
Behavior 

AA training produced both good avoiders and poor avoiders (Fig. 
1); good avoiders dramatically increased shuttling by session 7 
and poor avoiders did not (Group x Session, ^(6,54) =10, P < 
0.01). During the shock-free test, poor avoiders froze more 
(t(9) = 3.9, P < 0.01) and shuttled less (t^, = 4.1, P < 0.01) than 
good avoiders. Freezing and shuttling correlated negatively dur- 

,P<0.01). 

c-Fos expression 

c-Fos density after AA testing was compared for box controls, good 
avoiders, and poor avoiders in amygdala, medial PFC, NAC, dorsal 
striatum, PAG, and hippocampus. Key subregions, as delineated 
by Pitkanen et al. (1997), were analyzed separately. Differences 
along the AP axis (relative to bregma) are reported only if the 
three-way (Group x Subregion x AP-level) interactions were sta- 
tistically significant. Significant differential c-Fos expression ef- 
fects are detailed in Figure 2, and all results are summarized in 
Figure 3. 

Six amygdala nuclei were assessed together: lateral (dorsal 
and ventral subregions [LA^ and LAy, respectively]), basal (anteri- 
or, posterior, and ventral subregions [BAa, BAp, and BAy, respec- 
tively]), accessory basal (AB), medial (dorsal and ventral 
subregions [MEd and MEy, respectively]), central (lateral and me- 
dial subregions [CEl and CEm, respectively]) and cortical (CO). 
The three-way interaction between Group, Subregion, and 
AP-level was not significant (-F(46,299) = 1-2, P = 0.2). Large c-Fos 
differences were observed throughout the amygdala; effects of 
Group (-^(2,13) = 318), Subregion (F(io,i30) = 88), and their interac- 
tion (f (20,1 30) = 2.1, P<0.01) were all significant. c-Fos density 
was higher in all amygdala subregions for AA-trained rats (good 
and poor avoiders) compared to box controls (P values <0.05). 



AA training 

(with shocks) 




With the exception of AB (t,i30) = 1.8, P = 0.07) and CO (t,i30) = 
0.6, P — 0.56), c-Fos differed between good and poor avoiders in 
every amygdala subregion (t(i30) values >2.4, P values <0.05). 
c-Fos correlated negatively with freezing during the final test in 
five amygdala subregions: LAd (-3.8 mm from bregma, — 
0.76, f,i,9) = 28.7, P< 0.01), MEd (-3.3 mm from bregma, = 



'^(1,9) 

0.37, f(i,g) = 5.2, P<0.05), MEy (- 
0.52, P,i9) = 9.9, P=0.01), BAp (- 



0.58, F, 



f(i,g} 
(1,9) ' 



-2.3 mm from bregma, 
3.3 mm from bregma, 



12.6, P< 0.01), and CEl (-2.8 mm from bregma. 



r — 0.52, f (1,9) — 9.6, P < 0.05). Conversely, c-Fos correlated pos- 
itively with shuttling in seven amygdala subregions: LAd (-3.8 
mm from bregma, = 0.62, f (1,9, = 14.5, P<0.01), LAy (-3.3 
mm from bregma, r^ = 0.42, P,i,9)=6.5, P<0.05), MEy (-2.3 



= 0.53, P(i,9)= 10.3, P=0.01), BAp (-3.3 
•^ = 0.38, f(i,9) = 5.4, P<0.05), AB (-3.3 
^ = 0.46, P(i,9, = 7.6, P<0.05), CEl (-2.8 
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Figure 1. Inverse relationship between Pavlovian and instrumental responses in Good vs. Poor avoid- 
ers. (Left) Mean AA responding during seven daily training sessions. (Middle) Mean freezing and shut- 
tling during the final shock-free test session. (Right) Negative correlation between freezing and shuttling 
for individuals during the test session. (AA) Active avoidance, (GA) good avoiders, (PA) poor avoiders. 
(*) P < 0.05 vs. GA group. Error bars = SEM. 



mm from bregma, ; 
mm from bregma, 
mm from bregma, 
mm from bregma, r^ = 0.75, f ,1,9, = 27.4, P<0.01), and CEm 
(-2.8 mm from bregma, r^=0.44, P(i,9) = 7.1, P<0.05). c-Fos 
never correlated positively with freezing or negatively with shut- 
tling. Thus, only four amygdala subregions (LAd, CEl, MEy, and 
BAp) showed differential c-Fos expression (good vs. poor avoiders) 
that correlated with both behavioral measures (freezing and shut- 
tling) during the final test (Fig. 2). 

Two medial PFC subregions were assessed: prelimbic (PL) and 
infralimbic (IL). Large c-Fos differences were observed throughout 
PFC (P(2,i3) = 108, P< 0.01) and AA-trained rats showed higher 
c-Fos expression than box controls in both subregions (P values 
<0.01). The three-way interaction between Group, Subregion, 
and AP-level was statistically significant (P(4,25) = 3.6, P= 0.02). 
Post-hoc contrasts revealed c-Fos differences between good and 
poor avoiders in both mPFC subregions at -1-3.72 mm from 
bregma (PL, t(24) = 3.4, P<0.01; IL, t,24) = 3.7, P<0.01) but 
smaller differences at -1-3.0 mm (PL, t(24) = 2.1, P = 0.04), especial- 
ly in IL(t(24) = 1.4,P= 0.2). c-Fos correlated negatively with freez- 
ing during the final test in IL only (-1-3.72 mm from bregma, = 
0.40, P(i,9) = 6.0, P < 0.05) Conversely, c-Fos density correlated 
positively with shuttling in PL (-1-3.72 mm from bregma, r^ = 
0.51, f,i,9) = 9.4, P < 0.01) and IL (-1-3.72 mm from bregma, = 
0.70, P(i_9) = 20.6, P<0.01). c-Fos never correlated positively 
with freezing or negatively with shuttling. Thus, only anterior 
IL showed differential c-Fos expression that correlated with both 
behavioral measures during the final test (Fig. 2). 

Subregions of four additional brain areas were also assessed: 
PAG (dorsal and ventral [PAGd and PAGy, respectively]), NAC 
(core and shell [NACc and NACs, respectively]), dorsal striatum 
(dorsomedial and dorsolateral [DMS and DLS, respectively]), and 
hippocampus (CAl). Group differences 
in c-Fos density were found in PAG 
(f(2,i3) = 16.5, P<0.01), NAC (f,2,i3) = 
10.3, P<0.01), and dorsal striatum 
(^■(2,13) = 43.0, P< 0.01), but not hippo- 
campus (f(2,i3) = 0.21). However, in 
each case these were driven by large dif- 
ferences between AA-trained (good and 
poor avoiders) and nontrained (box con- 
trol) rats (t|i3, > 2.9, P values <0.01). 
Further, group differences did not vary 
according to subregion or AP level (P val- 
ues for Group x Subregion and Group x 
Subregion x AP-level interactions all 
>0.05) and post-hoc contrasts revealed 
no c-Fos differences between good and 
poor avoiders (t(i3, values <1.9, P values 
>0.08). DLS was the only region to show 
a trend toward differential c-Fos expres- 
sion for good vs. poor avoiders (t(i3) = 
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Correlations 

C-Fos freezing shuttling PoorAvoider Good Avoider 
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-o- Good Avoiders (n=5) -•- Poor Avoiders (n=6) -•- Box Controls (n=5} 

Figure 2. Post-test c-Fos expression is associated with Good vs. Poor avoidance in amygdala and prefrontal cortex. (Left) Mean density of c-Fos^ cells for 
Good avoiders, Poor avoiders and box controls at multiple anterior-posterior (AP) levels (relative to bregma). (Middle) In each region shown, c-Fos cor- 
related negatively with freezing and positively with shuttling. With the exception of freezing and CEm c-Fos, all correlations are statistically significant. 
(Right) Representative photomicrographs depicting c-Fos in Good and Poor avoiders (approximate AP level, in mm from bregma, shown in bottom 
right of Good avoider images). (LAd) Dorsal division of lateral amygdala, (BA) basal amygdala, (CEJ lateral division of central amygdala, (CEm) 
medial division of central amygdala, (MEv) ventral division of medial amygdala, (IL) infralimbic prefrontal cortex. (*) P < 0.05, (**) P < 0.01, (*•*) P < 
0.001 for Good vs. Poor avoider contrasts at specific AP levels. AP level for correlations indicated by x-axis boxes on c-Fos graphs. Error bars = SEM. 
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Figure 3. Summary of differential c-Fos expression effects. Good avoider values were normalized 
using Poor avoider group means and effects are expressed as a percentage of Poor avoiders (mean + 
SEM). Differential c-Fos expression in all 20 brain regions examined, rank ordered by effect magnitude. 
Bar shading indicates statistical significance of c-Fos expression differences (Good vs. Poor avoiders), 
and correlations between c-Fos expression and behavior (see Key). The absence of differential expres- 
sion is indicated by the dashed line at 1 00%. (CE) Central amygdala, (BA) basal amygdala, (LA) lateral 
amygdala, (ME) medial amygdala, (AB) accessory basal amygdala, (CO) cortical amygdala, (IL) infralim- 
bic prefrontal cortex, (PL) prelimbic prefrontal cortex, (PAG) periacqueductal gray, (DMS) dorsomedial 
striatum, (DLS) dorsolateral striatum, (NAC) nucleus accumbens, (CAl) hippocampal CAl area, (A) an- 
terior, (P) posterior, (D) dorsal, (V) ventral, (M) medial, (L) lateral, (C) core, (S) shell. Error bars = SEM. 



1.8, P — 0.09). Further, c-Fos did not correlate with either behav- 
ioral measure in any of these regions or subregions (f(i,9) values 
< 1.9, P values >0.19). 

Discussion 

Active avoidance (AA) is an important instrumental learning par- 
adigm with clear relevance to the development and treatment of 
human pathological anxiety. In AA, subjects learn to suppress 
Pavlovian reactions and emit actions that limit exposure to threat- 
ening or harmful stimuli. However, in contrast to other condi- 
tioning paradigms like fear conditioning or passive avoidance, 
very little is known about the neurobiological mechanisms medi- 
ating AA — most likely because a defined neurocircuit is lacking. 
There are many reasons for this, but a major reason may be that 
AA training induces both Pavlovian reactions, like freezing, and 
instrumental actions, like shuttling, that are incompatible, com- 
peting behaviors (Lazaro-Munoz et al. 2010). Thus, AA responding 
is not a pure readout of AA learning, which can confuse efforts to 
identify an underlying neurocircuit. 

Instead of excluding poor avoiders from analysis, we exploit- 
ed the stark behavioral differences between good and poor avoid- 
ers to elucidate the AA neurocircuit. Good avoiders displayed high 
AA rates and low freezing following a moderate amount of train- 
ing, whereas poor avoiders showed an opposite pattern. Of the 
20 brain regions examined, only five showed differential c-Fos ex- 
pression that correlated with both behaviors. Four were subre- 
gions of amygdalar nuclei — dorsal LA, ventral ME, lateral CE, 
and posterior BA. The fifth was a subregion of PFC, anterior IL. 
In each of these regions, c-Fos correlated positively with shuttling 
and negatively with freezing. Although c-Fos induction certainly 
occurred in many other regions examined, it was not related to 
the behavioral differences observed between good and poor avoid- 
ers following identical training and testing. These results support 
the notion that activity in specific amygdala-PFC neurocircuits 
mediates the suppression of Pavlovian reactions and the transi- 
tion to instrumental actions with AA training. 



Many studies have examined lEG 
activation related to aversive condition- 
ing; however, the vast majority used 
Pavlovian fear conditioning or passive 
avoidance, and have produced inconsis- 
tent results (for discussions, see Scicli 
et al. 2004; Knapska et al. 2007). We are 
aware of no studies examining lEG acti- 
vation with Sidman AA, but several 
have examined signaled AA (Nikolaev 
et al. 1992; Duncan et al. 1996; Savo- 
nenko et al. 1999; Radwanska et al. 
2002; Saha and Datta 2005). Unfortu- 
nately, the results fail to paint a clear pic- 
ture of the AA neurocircuit. The most 
consistent findings are of elevated activi- 
ty in amygdalar LA, BA, and ME nuclei 
following AA training. One study also 
found elevated c-Fos in mPFC following 
AA training (Duncan et al. 1996). How- 
ever, most of these studies identified ad- 
ditional brain regions of presumably 
equal importance, such as the cingulate 
cortex, lateral septum, and various hy- 
pothalamic nuclei (Duncan et al. 1996; 
Saha and Datta 2005), with little overlap 
between studies. 

At first glance, several findings ap- 
pear to be at odds with our results. For ex- 
ample, some studies identified CO and PAG as important for AA, 
and none found significant activation in CE. However, several dif- 
ferences between our study and prior studies may account for 
these apparent inconsistencies. First, we examined activation pat- 
terns following a moderate amount of AA training (seven ses- 
sions). All but one of the above studies used a single training 
session. Thus, our protocol clearly identified good and poor avoid- 
ers before the analysis, whereas the others could not take advan- 
tage of this distinction. This also makes it likely that our 
analysis primarily implicates performance mechanisms, whereas 
the above studies may be more relevant to learning. Second, all 
of the above studies used control conditions (e.g., naive or box 
control) that provide a poor contrast with AA training. Selecting 
an appropriate associative control is, indeed, difficult for AA stud- 
ies (for discussions, see Church 1989; Nikolaev et al. 1992); how- 
ever, comparisons with untrained controls lead to identification 
of any region activated by training, regardless of any specific 
role in AA learning or performance. This problem may have 
been magnified by the use of test sessions that included shock pre- 
sentations. Our design allowed us to circumvent these difficulties 
by contrasting good and poor avoiders following identical train- 
ing and testing. It should be noted that we also found significant 
c-Fos activation in many of the same regions identified in past 
studies (by comparison to box controls), sometimes massive acti- 
vation (e.g., cortical amygdala). However, in the absence of evi- 
dence for differential activity between good and poor avoiders, 
it is difficult to conclude that these regions contribute to AA per- 
formance. Last, previous studies failed to evaluate potentially im- 
portant differences within subregions of brain nuclei (e.g., 
Nikolaev et al. 1992). 

It is interesting, and somewhat unexpected, that c-Fos corre- 
lated positively with shuttling and negatively with freezing in 
all of the regions depicted in Figure 2. We expected to find some 
regions where excessive freezing in poor avoiders was associated 
with higher c-Fos expression, perhaps regions mediating Pavlovi- 
an freezing, like medial CE or ventral PAG (Hitchcock and Davis 
1991; Kim et al. 1993). The positive relationship between c-Fos 



www.learnmem.org 



449 



Learning & Memory 



Active threat responding and amygdala-PFC c-Fos 



and avoidance in medial CE is a bit puzzling, especially since CE is 
not necessary for avoidance and CE lesions facilitate avoidance 
when freezing interferes (Choi et al. 2010; Lazaro-Munoz et al. 
2010). One possibility is that heightened activity related to freez- 
ing is more likely to be observed very early in training, when 
Pavlovian reactions are rapidly acquired and stored. Another pos- 
sibility is that different cell populations within these brain regions 
contribute to AA or freezing (e.g., excitatory vs. inhibitory neu- 
rons), even if the region is not essential for AA (e.g., CE). Finally, 
Sidman AA is a difficult, multi-faceted task. Performance depends 
on Pavlovian learning, instrumental learning, interval timing, 
safety signals, and specific action sequences. Successful negotia- 
tion of this task depends on the coordinated recruitment of circuit 
components mediating these diverse functions. Thus, poor avoid- 
ers may show less overall c-Fos activity because they fail to recruit 
these interdependent processes and fail to experience avoidance 
feedback cues. 




]nUrunLC]ital [nvtrunicntal 



Figure 4. Worl<ing model: neural circuit mediating the progression 
from Pavlovian reactions to instrumental actions with AA training. Dark 
shading represents primarily Pavlovian processes early in training. 
Lighter shading represents the emergence of instrumental processes 
with continued training. (1) Early in training, dorsal LA learns and stores 
Pavlovian CS-US associations. Subsequent threats (CSs) activate LA and 
CE, triggering activity in downstream regions mediating Pavlovian reac- 
tions (e.g., freezing). As training progresses, (2) subjects first learn to effi- 
ciently escape the US and then (3) to escape the CS and prevent the US 
(avoidance). We hypothesize that ME is important for initial escape learn- 
ing that prepares the subject to avoid. Once the "escape" response occurs 
during the CS, acquisition of the avoidance contingency can proceed and 
strengthen, via connections from LA to BA. After a moderate amount of 
training, threats activate LA and trigger both Pavlovian and instrumental 
memories that compete for control of behavior, via CE and BA outputs, 
respectively. PFC may also play an important role in the balance 
between Pavlovian reactions and instrumental actions. (1) Early in train- 
ing, PFC is likely suppressed by heightened amygdala activity. However, 
akin to extinction, PFC may suppress Pavlovian threat reactions later in 
training to allow for the acquisition and expression of avoidance. (4) 
Ultimately, with overtraining the entire amygdala becomes unnecessary 
and AA expression depends on extra-amygdala regions (not yet identi- 
fied). Although parts remain speculative, available lesion data and 
present c-Fos results are consistent with this model. Poor avoidance 
could result from excessive LA^ CE activation of Pavlovian reactions, 
failure of PFC to suppress CE outputs, or failure to transfer AA control to 
extra-amygdala regions with overtraining. (LA) Lateral amygdala, (BA) 
basal amygdala, (CE) central amygdala, (ME) medial amygdala, (PFC) 
prefrontal cortex, (CS) conditioned stimulus, (US) unconditioned stimu- 
lus, (AA) active avoidance. 



Our findings may help refine models of the AA neurocircuitry 
(see Fig. 4). For instance, LA, BA, and CE have all been impli- 
cated in Pavlovian freezing, instrumental AA, or their competition 
(Hitchcock and Davis 1991; Poremba and Gabriel 1999; Anglada- 
Figueroa and Quirk 2005; Choi et al. 2010; Lazaro-Munoz et al. 
2010). However, our c-Fos results highlight the potential impor- 
tance of specific subregions within these nuclei. For instance, 
LAd, rather than the whole basolateral complex, may be particu- 
larly important for AA, as it is for Pavlovian conditioning (Repa 
et al. 2001; Han et al. 2007). Interestingly, our findings indicate 
an important role for CEl in AA, even though CEm is more closely 
associated with threat responding (Hitchcock and Davis 1991). 
Several recent papers suggest that a population of inhibitory neu- 
rons in CEl may be critical for suppressing threat reactions like 
freezing (Ciocchi et al. 2010; Gozzi et al. 2010; Haubensak et al. 
2010). We hypothesize that differential c-Fos expression in CEl 
occurs in these GABAergic "CSoff" cells with AA. Finally, posterior 
regions of BA may also play a special role. Thus, our findings may 
help identify specific cell populations in amygdala that contribute 
to response variability following AA training. 

Our analyses also highlight two new regions that may be im- 
portant for AA: anterior IL-PFC and ventral ME. IL-PFC has a well- 
established role in fear extinction, where nonreinforced CS expo- 
sures lead to inhibitory learning and suppression of Pavlovian re- 
actions. The involvement of IL-PFC in AA seems consistent with 
fear extinction findings (Herry and Mons 2004; Hefner et al. 
2008; Sotres-Bayon et al. 2008); perhaps IL-PFC plasticity is neces- 
sary to suppress amygdala-mediated reactions like freezing and al- 
low for AA learning and expression. Very recent findings support 
this hypothesis; damage or protein synthesis blockade in IL-PFC 
both impair signaled AA (Moscarello and LeDoux 2013). It should 
be noted that differential activity in IL-PFC could also reflect dif- 
ferences in extinction of Pavlovian vs. instrumental responding 
in poor vs. good avoiders, since our AA test session was shock-free. 
Last, a large difference in c-Fos expression between good and poor 
avoiders was found in MEy. ME has no known role in AA behavior; 
however, it has never been directly studied. Interestingly, ME 
activity is associated with escape behavior (e.g., Herdade et al. 
2006), and learned escape (of the US and CS) may be a critical 
step in the transition from Pavlovian reactions to instrumental ac- 
tions with AA training (BoUes 1969). 

In summary, we evaluated Pavlovian freezing, instrumental 
shuttling, and brain c-Fos expression in good vs. poor avoiders. 
This approach identified only five discrete subregions of amygdala 
and PFC where neural activity correlated with both reactive 
(Pavlovian) and proactive (instrumental) defensive behavior. 
These findings provide converging evidence, from animals with 
intact brains, that response competition following AA training de- 
pends critically on specific mPFC-amygdala circuits. Naturally 
occurring variations in amygdala-mPFC activity with AA resem- 
ble those found in good vs. poor extinguishers (e.g., Hefner 
et al. 2008). Thus, AA and extinction may share a common mech- 
anism that contributes to a "poor-coping" phenotype when 
dysfunctional. 



Materials and Methods 
Subjects/apparatus 

Male Sprague-Dawley rats (Hilltop Labs, Scottdale, PA) weighing 
250-300 g were maintained on a 12:12-h light cycle with ad libi- 
tum food and water. Experiments were approved by the NYU- 
lACUC and conformed to NIH Guidelines. Behavioral training/ 
testing was conducted in two-way shuttleboxes controlled by 
GraphicState software (Coulbourn Instruments). Shuttling was 
registered by infrared beams and final tests were recorded to 
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DVD for freezing analyses. Freezing was assessed during tlie first 2 
min of sfiock-free tests by observers blind to group specification. 

Sid man AA protocol 

Sidman AA was chosen over signaled AA because it is a more diffi- 
cult protocol that produces a higher percentage of poor avoiders 
(Choi et al. 2010; Lazaro-Munoz et al. 2010). Forty-two rats re- 
ceived seven daily 25-min training sessions (excluding weekends). 
Five good avoiders and six poor avoiders were selected for further 
analysis, as described previously (Lazaro-Munoz et al. 2010). 
Briefly, shuttling between compartments delayed the delivery of 
scrambled footshock USs (1 mA, 0.5 sec) by 30 sec (R-S interval). 
In the absence of shuttling, US delivery occurred every 5 sec (S-S 
interval). R-S interval shuttles were considered avoidance respons- 
es and S-S interval shuttles were escape responses. All shuttles pro- 
duced 0.3-sec feedback stimuli (houselight blink). Twenty-four 
hours after session 7, good and poor avoiders were given a shock- 
free test, otherwise identical to training. Five additional box- 
control rats received equivalent exposure to the chambers, but 
no shocks. 

Perfusion 

Ninety minutes after the AA test, rats were anesthetized with chlo- 
ral hydrate (150 mg/kg) and perfused transcardially with 4% para- 
formaldehyde in O.IM phosphate buffer (pH 7.4). Brains were 
removed, bathed in paraformaldehyde for 3 hr, and then trans- 
ferred to a 30% sucrose/O.lM phosphate buffer at 4°C overnight. 
Frozen sections (40 |j,m) were then cut with a sliding microtome 
along the frontal plane. 

c-Fos immiinoreactivity 

Brain sections were processed with anti-c-Fos antiserum raised in 
rabbit (Ab-5, Calbiochem, lot-D07099, dilution = 1:20,000). 
Primary antiserum was localized using an avidin-biotin complex 
system (ABC; Vector Laboratories). Briefly, sections were incubat- 
ed in biotinylated goat anti-rabbit IgG solution (Vector Laborato- 
ries), then placed in mixed avidin-biotin horseradish peroxidase 
complex solution (ABC Elite Kit; Vector Laboratories) (90 min/ 
step at 22° C). The peroxidase complex was incubated in chromo- 
gen solution containing 0.02% 3,3'-diaminobenzidine tetrahy- 
drochloride (DAB) (Sigma) with 0.3% nickel-ammonium sulfate 
in 0.05M Tris-buffer (pH 7.6), then in chromogen solution with 
hydrogen peroxide (1:3000) (10 min/step). The DAB reaction 
was halted by extensive washing in PBS (pH 7.4). Sections were 
mounted on gelatin-coated slides, dehydrated, and coverslipped 
with DPX (Sigma). An adjacent reference series was Nissl stained. 

Quantification 

c-Fos-immunoreactive neurons were evaluated from 10 x images 
(Nikon Eclipse 80i-microscope with Digital Camera DXM1200F). 
Regions of interest (ROIs) were manually delineated, guided by ad- 
joining Nissl-stained sections and a rat brain atlas (Paxinos and 
Watson 2005). Border delineation, cell counting, and area mea- 
surements were done with Image-J software (Version 1.44b). At 
least two measurements along the anterior- posterior (AP) axis 
were made for each ROI. ROIs were chosen based on hypothesized 
or known roles in Pavlovian fear, AA, or appetitive instrumental 
conditioning (Cain and LeDoux 2008). 

Statistical analyses 

Avoidance training data were analyzed using two-way (Group x 
Session) repeated measures ANOVAs with Bonferroni post-tests. 
Shock-free tests were analyzed with two-tailed unpaired f-tests. 
Since avoidance differences during the Session 8 test occurred 
mainly during the first 10 min of testing, all analyses reflect 
behavior during this period only. Box controls were included as 
a control for c-Fos analyses, but not behavioral analyses, because 
they were never shocked, never froze, and, by definition, could 
not emit AA responses. Group effects on c-Fos density in major 
brain regions (amygdala, mPFC, PAG, NAG, dorsal striatum, and 



hippocampus) were evaluated with separate mixed model 
ANOVAs (SAS PROG MIXED procedure with ESTIMATE state- 
ments for interaction contrasts between groups). Since major 
brain regions were usually divided into subregions, and multiple 
measures were taken along the AP axis, AP levels were nested in 
subregions, and subregions were nested in subjects (rats) for the 
analyses. Linear regression analyses evaluated correlations be- 
tween behavior and c-Fos expression, for both good and poor 
avoiders together, in specific ROIs. All data were logio transformed 
prior to statistical analyses due to heterogeneity of variance, ct = 
0.05 for all analyses. 

Acknowledgments 

Research supported by an NIMH grant to J.E.L. (ROI MH38774), 
an NSF grant to J.E.L. (0920153), a NIDA grant to J.E.L. 
(ROI DA029053), an NIMH grant to C.K.C. (R21 MH097125), a 
NIDA subaward to C.K.C. (F6761-01), an NIMH fellowship 
to C.K.C. (NRSA MH077458), an NIMH fellowship to G.L.-M. 
(F31MH086294-01A1), an NIMH fellowship to J.M.M. 
(F32MH094061), and CAPES (#2350/09-2) and FAPESP grants 
(#11/08575-7, 12/06825-9) to R.C.R.M. We thank Hillary Schiff 
for helpful comments, Claudia Farb and Sneh Kadakia for assis- 
tance with histology and immunohistochemistry, and Sanghan 
Lee and Eva Petkova for aiding with statistical analyses. 



References 

Anglada-Figueroa D, Quirk GJ. 2005. Lesions of the basal amygdala block 
expression of conditioned fear but not extinction. / Neiirosci 2S: 
9680-9685. 

Baum M, Poser EG. 1971. Comparison of flooding procedures in animals 

and man. Beliav Res Ther 9: 249-254. 
Bolles RC. 1969. Avoidance and escape learning: Simultaneous acquisition 

of different responses. / Comp Physio] Psychol 68: 355-358. 
Bolles RC, Popp RJ Jr. 1964. Parameters affecting the acquisition of Sidman 

avoidance, j Exp Anal Behav 7: 315-321. 
CainCK, LeDouxJE. 2008. Brain mechanisms of Pavlovian and instrumental 

aversive conditioning. In Handbook of anxiety and fear, Vol. 1 7 (ed. 

Nutt DJ, et al.), pp. 103-125. Elsevier Academic Press, Amsterdam. 
Choi JS, Cain CK, LeDouxJE. 2010. The role of amygdala nuclei in the 

expression of auditory signaled two-way active avoidance in rats. Learn 

Mem 17: 139-147. 
Church RM. 1989. The yoked control design. In Aversion, avoidance and 

anxiety: Perspectives on averslvely motivated behavior (ed. Archer T, 

Nilsson L), pp. 403-413. Erlbaum, Hillsdale, NJ. 
Ciocchi S, Herry C, Grenier F, Wolff SBE, Letzkus JJ, Vlachos I, Ehrlich I, 

Sprengel R, Deisseroth K, Stadler MB, et al. 2010. Encoding of 

conditioned fear in central amygdala inhibitory circuits. Nature 468: 

277-282. 

Delgado MR, Olsson A, Phelps EA. 2006. Extending animal models of fear 

conditioning to humans. Biol Psychol 73: 39-48. 
Duncan GE, Knapp DJ, Breese GR. 1996. Neuroanatomical characterization 

of Eos induction in rat behavioral models of anxiety. Brain Res 713: 

79-91. 

Gozzi A, Jain A, Giovanelli A, Bertollini C, Crestan V, Schwarz AJ, 

Tsetsenis T, Ragozzino D, Gross CT, Bifone A. 2010. A neural switch for 
active and passive fear. Neuron 67: 656-666. 

Han JH, Kushner SA, Yiu AP, Cole CJ, Matynia A, Brown RA, Neve RL, 
Guzowski JF, Silva AJ, Josselyn SA. 2007. Neuronal competition and 
selection during memory formation. Science 316: 457-460. 

Haubensak W, Kunwar PS, Cai H, Ciocchi S, Wall NR, Ponnusamy R, Biag J, 
Dong HW, Deisseroth K, Callaway EM, et al. 2010. Genetic dissection of 
an amygdala microcircuit that gates conditioned fear. Nature 468: 
270-276. 

Hefner K, Whittle N, Juhasz J, Norcross M, Karlsson RM, Saksida LM, 

Bussey TJ, Singewald N, Holmes A. 2008. Impaired fear extinction 

learning and cortico-amygdala circuit abnormalities in a common 

genetic mouse strain. / Neuroscl 28: 8074-8085. 
Herdade KG, Strauss CV, Zangrossi Junior H, Viana MB. 2006. Effects of 

medial amygdala inactivation on a panic-related behavior. Behav Brain 

Res 172: 316-323. 
Herry C, Mons N. 2004. Resistance to extinction is associated with impaired 

immediate early gene induction in medial prefrontal cortex and 

amygdala. Eur / Neuroscl 20: 781-790. 
Hitchcock JM, Davis M. 1991. Efferent pathway of the amygdala involved 

in conditioned fear as measured with the fear-potentiated startle 

paradigm. Behav Neuroscl lOS: 826-842. 



www.learnmem.org 



451 



Learning & Memory 



Active threat responding and amygdala-PFC c-Fos 



Kim JJ, Rison RA, Fanselow MS. 1993. Effects of amygdala, hippocampus, 
and periaqueductal gray lesions on short- and long-term contextual 
fear. BehavNeuwsci 107: 1093-1098. 

Knapska E, Radwanska K, Werka T, Kaczmarek L. 2007. Functional 
internal complexity of amygdala: Focus on gene activity 
mapping after behavioral training and drugs of abuse. Physiol Rev 
87: 1113-1173. 

Lazaro-Munoz G, LeDoux JE, Cain CK. 2010. Sidman instrumental 
avoidance initially depends on lateral and basal amygdala and is 
constrained by central amygdala-mediated Pavlovian processes. Biol 
Psychiatiy 67: 1120-1127. 

LeDoux JE. 2012. Rethinking the emotional brain. Neuron 73: 653-676. 

Levis DJ. 1989. The case for a return to a two-factor theory of avoidance: The 
failure of non-fear interpretations. In Contemporary learning theories: 
Pavlovian conditioning and the status of traditional learning theory (ed. 
Klein SB, Mowrer RR), pp. 227-277. Lawrence Erlbaum Associates, 
Hillsdale, NJ. 

McAllister DE, McAllister WR. 1991. Fear theory and aversively motivated 

behavior: Some controversial issues. In Fear, avoidance, and phobias: 

A fundamental analysis (ed. Denny MR). Erlbaum, Hillsdale, NJ. 
Moscarello JM, LeDoux JE. 2013. Active avoidance learning requires 

prefrontal suppression of amygdala-mediated defensive reactions. 

jNeurosci 33: 3815-3823. 
Mowrer OH, Lamoreaux RR. 1946. Fear as an intervening variable in 

avoidance conditioning. / Comp Psychol 39: 29-50. 
Nikolaev E, Werka T, Kaczmarek L. 1992. C-fos protooncogene expression 

in rat brain after long-term training of two-way active avoidance 

reaction. Behav Brain Res 48: 91-94. 
Paxinos G, Watson C. 2005. The rat brain in stereotaxic coordinates. Academic 

Press, Sydney, Australia. 
Pitkanen A, Savander V, LeDoux JE. 1997. Organization of intra- 

amygdaloid circuitries in the rat: An emerging framework 

for understanding functions of the amygdala. Trends Neurosci 

20: 517-523. 

Poremba A, Gabriel M. 1999. Amygdala neurons mediate acquisition but 
not maintenance of instrumental avoidance behavior in rabbits. 
I Neurosci 19: 9635-9641. 



Radwanska K, Nikolaev E, Knapska E, Kaczmarek L. 2002. Differential 
response of two subdivisions of lateral amygdala to aversive 
conditioning as revealed by c-Fos and P-ERK mapping. Neuroreport 
13: 2241-2246. 

Repa JC, Muller J, Apergis J, Desrochers TM, Zhou Y, LeDoux JE. 2001. Two 

different lateral amygdala cell populations contribute to the initiation 

and storage of memory. Nat Neurosci 4: 724-731. 
Rescorla RA, Solomon RL. 1967. Two process learning theory: Relationships 

between Pavlovian conditioning and instrumental learning. Psychol 

Rev 74: 151-182. 

Saha S, Datta S. 2005. Two-way active avoidance training-specific increases 
in phosphorylated cAMP response element-binding protein in the 
dorsal hippocampus, amygdala, and hypothalamus. Eur J Neurosci 
21: 3403-3414. 

Savonenko A, Filipkowski RK, Werka T, Zielinski K, Kaczmarek L. 1999. 
Defensive conditioning-related functional heterogeneity among nuclei 
of the rat amygdala revealed by c-Fos mapping. Neuroscience 94: 
723-733. 

Scicli AP, Petrovich GD, Swanson LW, Thompson RF. 2004. Contextual fear 
conditioning is associated with lateralized expression of the immediate 
early gene c-fos in the central and basolateral amygdalar nuclei. Behav 
Neurosci IIS: 5-14. 

Solomon RL, Wynne EC. 1954. Traumatic avoidance learning: The 

principles of anxiety conservation and partial irreversibility. Psychol Rev 
61: 353. 

Sotres-Bayon F, Corcoran KA, Peters J, Sierra-Mercado D. 2008. Neural 

correlates of individual variability in fear extinction. / Neurosci 

28: 12147-12149. 
Yehuda R, LeDoux J. 2007. Response variation following trauma: A 

translational neuroscience approach to understanding PTSD. Neuron 

56: 19-32. 

Yehuda R, Flory JD, Southwick S, Charney DS. 2006. Developing an agenda 
for translational studies of resilience and vulnerability following 
trauma exposure. Ann N Y Acad Sci 1071: 379-396. 



Received March 8, 2013; accepted in revised form June 4, 2013. 



www.Iearnmem.org 



452 



Learning & Memory 



